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Abstract 

In this note we consider the perfect integrator driven by Poisson process input. We derive its 
equilibrium and response properties and contrast them to the approximations obtained by applying 
the diffusion approximation. In particular, the probability density in the vicinity of the threshold 
differs, which leads to altered response properties of the system in equilibrium. 

Stationary solution of perfect integrator with excitation 

The membrane potential V of the perfect integrator [Tuckwell, 1988] evolves according to 
the stochastic differential equation 

i 

where ti are random time points of synaptic impulses events generated by a Poisson process 
with rate A and w is the magnitude is the voltage change caused by an incoming event. 
If V reaches the threshold Vq the neuron emits an action potential. After the threshold 
crossing, the voltage is reset to V ^ V — {Ve — Vr). This reset preserves the overshoot above 
threshold and places the system above the reset value by this amount. Biophysically the 
reset is motivated by considering each (5-impulse as the limit of a current extended in time. 
If V crosses Ve within such a pulse, after the reset to Vr the remainder of the pulse's charge 
causes a depolarization starting from Vr- We consider a population of identical neurons and 
assume a uniformly distributed membrane voltage between reset and threshold initially. In 
what follows we apply the formalism outlined in Helias et al. [2010]. The first and second 
infinitesimal moment [Ricciardi et al., 1999] of the diffusion approximation are 

Al = Xw ^= II 

A \ 2 def 2 

A2 = Xw = (J . 

The corresponding neuron driven by Gaussian white noise hence obeys the stochastic differ- 
ential equation 
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with the zero mean Gaussian white noise ^, {£,{t)^{t + s))t = ^{s). The probabihty flux 
operator is 

We renormahze the stationary probabihty density p{V) by the as yet unknown flux u as 
q{V) — ^p(V) so that the equilibrium density fulfills the stationary Fokker-Planck equation 

Sq{y) = \v^<V<V,. (1) 
Here lexpr. equals 1 if expr. is true, and else. The homogeneous solution of (1) is 

the particular solution which vanishes ^\.V = VQioxVr<V<VQ is 

^ JVe 



We first consider the case of Gaussian white noise input of mean fi and variance cr. A 
finite probability flux in this case requires q{Ve) — at threshold. We hence obtain the full 
solution that is continuous at reset as 

1 fl - e^^^"^^^ for Vr<V <Vq 

'^^^ = M \e!^^ (e-!^^^ - e-^^^) for - oo < F < F.. 

The normalization 1 = / p{V) dV = J q{V) dV determines the firing rate as 

/i Xw 



Ve-Vr Ve-Vr 

With /i/cr^ = Xjw the density is 



(2) 



1 Ji-ei^^-^") {oxVr<V<V6 
^'(^) = |^3^|efv^(e-iv._,-fv«j for-oo<T/<y,. 

We next take into account the finite synaptic jumps to obtain a modified boundary condition 
[Helias et al., 2010] at the firing threshold. For Vr < V < Vq the solution of (1) implies 
a recurrence relation between higher derivatives, such that the n-th derivative g^^^ can be 
expressed in terms of the function value itself as 

, 2ll 2 

„ 2/i , 2/i f2fi 2 \ /2/iy / 2 



with do = 1 and cq = for completeness. Applying equation (8) of Helias et al. [2010] allows 
to determine the boundary value at threshold as 



_ l + AEr=0(^^n(-^)"+^ 

l + A(->^ + i(-|^)(-^.)3) 



6 cr^ 
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Fig. 1: Equilibrium density and response shaped by background. (A) Probability 
density of voltage F of a perfect integrator driven by Gaussian white noise (3). (B) 
Probability density of a perfect integrator driven with excitatory synaptic impulses 
of finite size w causing the same drift and fluctuations as in A (5). The density near 
threshold most strongly differs on the scale of the synaptic amplitude w (gray shaded 
region). (C) An additional excitatory impulse of amplitude s shifts the density 
(shown for Gaussian white noise background input as in A), so that the gray shaded 
area exceeds the threshold. (D) The probability Pinst. to respond with an action 
potential corresponds to the area of density above threshold in C; it depends on the 
shape of the density near threshold (black: background of synaptic impulses of size 
w gray: Gaussian white noise background (6)). Parameters: w = Z mV, K = 0, 
Ve = 15 mV and A = 200 ^. 



In the case of finite jumps, the region below reset will never be entered, hence q{V) = for 
V < Vr. In order for the solution to fulfill the boundary value at threshold the homogeneous 
solution qh{V) = ^"^e^^^^"^^^/^ needs to be added to the particular solution Qp, so the 
complete stationary density is 



i for < y < Ve 

/i 



^0 for - 00 < V < Vr. 
The normalization therefore yields the same firing rate as in the case of Gaussian white noise 

/X Xw 



Ve -Vr Ve- Vr 



(4) 



This expression agrees with the intuitive expectation, because ^^^^'^ input impulses are 
needed to cause an output spike. Using this normalization, the density is 

10 tor — oo < \/ < Vr. 

The solutions for both cases are illustrated in Fig. 1A,B. 

Instantaneous and time dependent response 

The probability Pinst. ('^) ^^^^ ^ neuron in the population instantaneously emits an action 
potential in response to a single synaptic input of postsynaptic amplitude s equals the 
probability mass Pinst. (<§) = /^^_sPC^) dV crossing the threshold (shaded region in Fig. IC). 
In the the case of Gaussian white noise with (3) 
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rVe 

Xs)= / p{y)dv 

JVe-s 

S w/2 



1 



s>0 



Ve -Vr Ve- V, 



.(l-e-*)) 



This expression grows quadratically like Pinst.('^) — ^s>q Ve^v w" small synaptic ampli- 
tudes s as shown in Fig. ID. In the case of finite synaptic jumps using (5) we get 

The response grows linear in the amplitude s of the additional perturbing spike (Fig. ID). 
A linear approximation of the integral response can be obtained using the slope of the 
equilibrium rate (4) with respect to ji as 



Pint.(^)= / 



/ N 7 9^ 

u{t) — u dt = s 



For positive s this expression equals the integral instantaneous response (7) so the complete 
response is instantaneous in this case. For 5 < we only consider the special case of a 
synaptic inhibitory pulse with the same magnitude s = —w diS the excitatory background 
pulses, so the density is shifted away from threshold by w and the firing rate goes to 0. The 
density reaches threshold again if at least one excitatory pulse has arrived, which occurs 
within time t with probability Pk>i = 1 — e~^^. Given the excitatory event, the hazard rate 
of the neuron is y^^y , so the time dependent response is 

Kt) = (l- W-^*):^^^. (8) 

The density after the inhibitory event therefore is a superposition of the shifted density and 
the equilibrium density with the relative weighting given by the probabilities 1 — Pk>i and 
P/c>i, respectively 

... . _ 1 fU>oe-^^ foTVr-w<V <V0-W 

' ^~ Ve-Vr\l-U^oe-^' foTVr<V<Ve. 

The time evolution of the density following an excitatory and following an inhibitory impulse 
at t = is shown in Fig. 2 A and B, respectively. 
The integrated response probability 



Pint.(-^)= / J^{t)-Udt 

Jo 

Jo 



dt 



Ve-Vr 
w 

^~Ve-Vr' 

is the same as for an excitatory spike and coincides with the linear approximation. 



Stochastic resonance 

In order to observe stochastic resonance, the fiuctuation in the input to the perfect integrator 
must be varied. We therefore consider a zero mean Gaussian white noise input current cr^(t). 
Adding a constant restoring force fi{V) = — /iosign(V — K-), /io > assures that the voltage 
trajectories do not diverge to — oo and approach Vr in absence of synaptic input. The 
homogeneous solution of the stationary Fokker-Planck equation analog to (1) therefore is 

Qh{y) = e~^' ~ The particular solution for V > that fulfills the boundary condition 
q{Ve) = is found by variation of constants as 
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Fig. 2: Asymmetry of response. (A) An additional excitatory impulse of amplitude w 
shifts the probability density upwards such that a small part of the density exceeds 
the threshold. This leads to an instantaneous spiking response, visible as a J-shaped 
deflection in firing rate u (visualized by bars of finite width in A and C). The reset 
of the membrane voltage to Vr after the spike moves the exceeding density down, 
so the density immediately equals the state before the impulse. (B) An additional 
inhibitory impulse of amplitude —w deflects the density downwards (9). It does not 
cause a response concentrated at the time of the impulse (D). Instead, the firing rate 
u instantaneously drops and exponentially reapproaches its equilibrium value (8) 
as the density gradually relaxes to its steady state on the time scale 1/A, where A is 
the rate of synaptic background impulses. 
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so the complete solution follows as 

_ 1 f [e-^-^^^-^^) - l) for V,<V<Ve 

'^^^^ ^ fe-^^^--^") - l) e^(^-^-) for - 00 < y < K- 



Normalization again yields the equilibrium rate v 

1 = y" q(y) dV 

Mo 



Mo V 



and the normalized density is 

Fig. 3B visualizes the density for three different fluctuation amplitudes <j. In the limit of 
large ^ /io the density decreases proportional to between reset and threshold and 
falls off linearly towards threshold 



p{V) 



^ (1 + 1^(1^ - K)) for - < y < K. 



The red curve in Fig. 3B shows the tendency of such a linear decay towards threshold. The 
instantaneous response exhibits stochastic resonance, because the integrated voltage density 
near threshold assumes a maximum at a particular noise level a. This can already be judged 
from the zoom-in near threshold in Fig. 3C. Formally, the response to an incoming impulse 
of amplitude s is 

^inst. w = / v{y) dv = , . ^, — ^ - 

s<cr 1 Mo ^2 



o2 



(11) 



Mo \ / Mo 

The dependence on the noise is graphed in Fig. 3D. 
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Fig. 3: Stochastic resonance. (A) A model neuron receives balanced excitatory and in- 
hibitory background input (gray spikes). The probability of a particular synaptic 
impulse (black vertical bar at to) to elicit an immediate response by depends on the 
amplitude a of the fluctuations caused by the other synaptic afferents. (B) The 
spread of the probability density of voltage depends on the amplitude a of the fluc- 
tuations caused by all synaptic afferents (10). At low fluctuations (cr < dopt) it 
is unlikely to find the voltage near threshold, the density there is negligible (blue: 
cr = 5.5 mV). At intermediate fluctuations (cTopt), the probability of finding the 
density below threshold is elevated (green: <j = 11 mV). Increasing the fluctuations 
beyond this point (a > <Jopt) spreads out the density to negative voltages, effectively 
depleting the range near threshold (red: a = 16.5 mV). (C) Zoom-in of the prob- 
ability density near threshold (luminance coded with iso-density lines) over voltage 
V (horizontal axis) as a function of the magnitude of fluctuations a (vertical axis). 
At the optimal level aopt, the density near threshold becomes maximal. (D) The 
voltage integral of this density determines the probability of eliciting a spike (11) 
and has a single maximum at aopt- Further parameters are Vr = 0, Vq = 15 mV, 
/io = 5.0 mV/s. 



